Versatile keyboard input and output device

ABSTRACT

A versatile keyboard input and output device is described. The keyboard device includes a housing having a plurality of buttons, with each button individually clickable, and a capacitive sensing element under each button for touch sensing. The versatile keyboard input and output device further includes a lighting element under each button to provide selective lighting for each button, and a plurality of button glyphs for the plurality of buttons respectively, wherein the button glyphs are selectively visually changeable. The keyboard input device also includes a haptic feedback mechanism included in the housing for providing haptic feedback for the plurality of buttons.

CROSS-REFERENCE TO RELATED U.S. APPLICATION

This application is a continuation (divisional) application of the U.S.patent application Ser. No. 12/710,230 by S. Myers et al., filed on Feb.22, 2010, hereby incorporated by reference in its entirety.

FIELD OF THE INVENTION

The present invention is generally related to electronic user inputoutput devices.

BACKGROUND OF THE INVENTION

Gaming, or more particularly, electronic video gaming, is becomingincreasingly popular with people of all ages. Generally speaking, videogames involve interaction with a user interface to generate both visualand audible feedback on an electronic device. Modern video games alsouse other ways of providing interaction and information to the player,such as feedback via haptic peripherals, such as vibration or forcefeedback, with vibration sometimes used to simulate force feedback. Theelectronic systems used to play video games are generally referred to asplatforms. A platform refers to a specific combination of electronic orcomputer hardware which, in conjunction with certain software, operatesthe functionality of the video game. Example platforms include personalcomputers, video game consoles and portable or hand-held video devices.Such platforms range from large mainframe computers to small handhelddevices (e.g., cell phones, etc.).

Video game consoles and certain types of handheld video devicestypically use a specialized input device called a game controller. Forexample, one type of console game controller might consist of severalbuttons and one or more joysticks. Another type of game controller mayfeature a dozen buttons and one or more joysticks. Each consolemanufacturer typically implements their own specific game controllerlayout.

A PC game refers to a type of video game that is based on theutilization of a personal computer as its platform. The PC gametypically involves a player interacting with a personal computerconnected to a high-resolution screen (e.g., an external LCD monitor).

PC-based video games are generally more rich and complex than the othertypes of games, in many cases requiring very complex control systemsbuilt around the traditional mouse and keyboard paradigm. This isparticularly true for MMO (massively multiplayer online) games andreal-time strategy games. In these types of games, a keyboard is anindispensible control input for directional movement, complex menus,in-game shortcuts, and extra-game macros. Such functionality is verydifficult to replicate using console game controllers and hand-heldgaming devices.

A popular trend is providing rich and complex gameplay of PC-basedvideogames using more mobile platforms. As the gaming industry movesmore towards satisfying this desire for more mobile platforms, a keyobstacle has been continually encountered. This obstacle revolves aroundtranslating a full gaming keyboard experience into a small form factor.A typical laptop computer system may have a keyboard of sufficient sizeto enable an acceptable gaming experience, however most laptops are toolarge to be considered truly on-the-go mobile. Hence, the demand existsfor mobile gaming devices that are even smaller than a typical laptop,but the obstacle remains. This obstacle is a tremendous challenge formany reasons.

For example, one reason relates to the fact that MMOs typically utilizethe entire PC keyboard (including letters, numbers, F-keys, Page up,Page down, Tab, Escape, etc), and shrinking every function into a smallportable form factor is both a mechanical challenge and a usabilitynightmare. Having too many buttons on a small device becomes veryconfusing to the user.

Another reason relates to the fact that small handheld to mid-sizedkeyboards are typically utilized with only two thumbs rather than a fullten fingers. This greatly changes the learned interaction between theplayer and the input, resulting in slower response times and a lesssatisfying gaming experience. For example, map keys used during gamesare typically configured under each finger of the left hand so that theycan be quickly activated without looking (i.e., without taking your eyesoff the screen). However, blindly activating all of those map keys onlywith your thumbs presents a much greater challenge.

Another reason relates to the fact that games designed for the PC oftenhave small icons designed for PC monitors. Such icons can be, forexample, for activating certain in game features, changing betweenmodes, or the like. With a mouse on a large screen, these icons aresimple to select and click. But on the small screen typically associatedwith a portable gaming platforms with a less-precise pointing device,selecting those icons is a greater chore.

Some portable gaming platforms have touch screen interfaces, which helpsaddress the problems described above. However, virtual buttons on atouch screen still has drawbacks. These drawbacks include, for example,the fact that virtual buttons do not have the same tactile feedback asphysical buttons (e.g., even with haptics). Virtual buttons aregenerally not accessible without taking your eyes off the play area ofthe screen and looking at them. Additionally, virtual buttons stillrequire a relatively large screen to be effective since they requireyour fingers to occlude the screen.

SUMMARY OF THE INVENTION

Embodiments of the present invention implement a versatile and optimizedkeyboard device that greatly improves core aspects of user interactiondesign and physical design for a device that both accepts user input andprovides user feedback. Embodiments of the present inventionadvantageously employ advanced touch-sensitive technology andlight-enabling technology to greatly improve a user's keyboardexperience.

In one embodiment, the present invention is implemented as a keyboardinput/output device. The keyboard input/output device includes a housinghaving a plurality of buttons, with each button individually clickable,and a capacitive sensing element under each button for touch sensing.The keyboard input/output device further includes a lighting element(e.g., LEDs, etc.) under each button to provide selective lighting foreach button, and a plurality of button glyphs for the plurality ofbuttons respectively, wherein the button glyphs are selectively visuallychangeable.

In one embodiment, each button is individually clickable via theactuation of an independent dome switch for each button. In oneembodiment, the selective lighting for each button can be changed basedupon an application, device, or keyboard context (e.g., operating mode,operating configuration, or the like).

In one embodiment, the haptic feedback mechanism provides hapticfeedback localized to an individual button out of the plurality ofbuttons. Alternatively, the haptic feedback mechanism can provide hapticfeedback localized to a set of buttons out of the plurality of buttons.As another alternative, the haptic feedback mechanism can provide hapticfeedback to the housing (e.g., and thus the whole device) insubstantially its entirety. In one embodiment, the housing is sized as ahandheld device.

In another embodiment, the present invention is implemented as akeyboard input and output device having changeable glyphs for eachbutton. The keyboard input output device includes a housing having aplurality of buttons, with each button individually clickable. Each ofthe buttons includes a semi-translucent surface film and a maskcomprising a clear film screen having a plurality of opaque glyphnegatives and disposed under the surface film. A transparent segmentedLCD (liquid crystal display) layer is disposed under the mask. Anelectroluminescent backlight layer is disposed under the transparentsegmented LCD layer. The transparent segmented LCD layer functions byselectively allowing light from the backlight layer to shine through oneof the plurality of glyph negatives to implement visually changeableglyphs for each button.

The foregoing is a summary and thus contains, by necessity,simplifications, generalizations and omissions of detail; consequently,those skilled in the art will appreciate that the summary isillustrative only and is not intended to be in any way limiting. Otheraspects, inventive features, and advantages of the present invention, asdefined solely by the claims, will become apparent in the non-limitingdetailed description set forth below.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention is illustrated by way of example, and not by wayof limitation, in the figures of the accompanying drawings and in whichlike reference numerals refer to similar elements.

FIG. 1 shows a mobile computer system device having a versatile keyboardin accordance with one embodiment of the present invention.

FIG. 2 shows the versatile keyboard in a first configuration inaccordance with one embodiment of the present invention.

FIG. 3 shows the versatile keyboard in a second configuration inaccordance with one embodiment of the present invention.

FIG. 4 shows an exemplary physical implementation of a button of akeyboard in accordance with one embodiment of the present invention.

FIG. 5 shows an exemplary glyph changing implementation of buttons of akeyboard in accordance with one embodiment of the present invention.

FIG. 6 shows a plurality of scenarios of backlighting and LCDsegmentation to implement changeable glyphs in accordance with oneembodiment of the present invention.

FIG. 7 shows certain components of an exemplary versatile keyboardsystem according to one embodiment of the present invention.

FIG. 8 shows an exemplary computer system according to one embodiment.

DETAILED DESCRIPTION OF THE INVENTION

Although the present invention has been described in connection with oneembodiment, the invention is not intended to be limited to the specificforms set forth herein. On the contrary, it is intended to cover suchalternatives, modifications, and equivalents as can be reasonablyincluded within the scope of the invention as defined by the appendedclaims.

In the following detailed description, numerous specific details such asspecific method orders, structures, elements, and connections have beenset forth. It is to be understood however that these and other specificdetails need not be utilized to practice embodiments of the presentinvention. In other circumstances, well-known structures, elements, orconnections have been omitted, or have not been described in particulardetail in order to avoid unnecessarily obscuring this description.

References within the specification to “one embodiment” or “anembodiment” are intended to indicate that a particular feature,structure, or characteristic described in connection with the embodimentis included in at least one embodiment of the present invention. Theappearance of the phrase “in one embodiment” in various places withinthe specification are not necessarily all referring to the sameembodiment, nor are separate or alternative embodiments mutuallyexclusive of other embodiments. Moreover, various features are describedwhich may be exhibited by some embodiments and not by others. Similarly,various requirements are described which may be requirements for someembodiments but not other embodiments.

Some portions of the detailed descriptions, which follow, are presentedin terms of procedures, steps, logic blocks, processing, and othersymbolic representations of operations on data bits within a computermemory. These descriptions and representations are the means used bythose skilled in the data processing arts to most effectively convey thesubstance of their work to others skilled in the art. A procedure,computer executed step, logic block, process, etc., is here, andgenerally, conceived to be a self-consistent sequence of steps orinstructions leading to a desired result. The steps are those requiringphysical manipulations of physical quantities. Usually, though notnecessarily, these quantities take the form of electrical or magneticsignals of a computer readable storage medium and are capable of beingstored, transferred, combined, compared, and otherwise manipulated in acomputer system. It has proven convenient at times, principally forreasons of common usage, to refer to these signals as bits, values,elements, symbols, characters, terms, numbers, or the like.

It should be borne in mind, however, that all of these and similar termsare to be associated with the appropriate physical quantities and aremerely convenient labels applied to these quantities. Unlessspecifically stated otherwise as apparent from the followingdiscussions, it is appreciated that throughout the present invention,discussions utilizing terms such as “processing” or “accessing” or“writing” or “storing” or “replicating” or the like, refer to the actionand processes of a computer system, or similar electronic computingdevice that manipulates and transforms data represented as physical(electronic) quantities within the computer system's registers andmemories and other computer readable media into other data similarlyrepresented as physical quantities within the computer system memoriesor registers or other such information storage, transmission or displaydevices.

Embodiments of the present invention implement a versatile and optimizedkeyboard device that greatly improves core aspects of user interactiondesign and physical design for a device that both accepts user input andprovides user output and feedback. Embodiments of the present inventionadvantageously employ advanced touch-sensitive technology andlight-enabling technology to greatly improve a user's keyboardexperience. It should be noted that although embodiments of the presentinvention specifically address the issues and problems surroundingplaying complex games on a small device, embodiments may also beexpanded to a number of different uses in tangential areas.

FIG. 1 shows a mobile computing device 100 having a versatile keyboardin accordance with one embodiment of the present invention. As depictedin FIG. 1, the mobile computer system 100 comprises a display section110 that is flexibly coupled to a body portion 120 (e.g., housing orchassis, etc.), which itself includes a versatile keyboard, the uppersurface of which is visible, and a computer system (e.g., computersystem 800 of FIG. 8) which provides the computer implementedfunctionality for executing games, applications, and the like.

The FIG. 1 embodiment shows aspects whereby a traditional laptop typedevice can be made smaller while still preserving the ability to playcomplex games. In the FIG. 1 embodiment, the versatile keyboard of thebody portion 120, hereafter referred to simply as the versatile keyboard120, includes a number of buttons as shown. Each button has beenimplemented to include a capacitive touch sensing capability via theinclusion of one or more touch sensing elements. The capacitive sensingunder each button can be used for touch-detection. This touch-detectioncan produce pre-click feedback, gesture control, and other inputfunctionality to the versatile keyboard. Each button has beenimplemented such that they are physically clickable (e.g., a physicalmovement associated with a user actuation). In one embodiment,individually clickable buttons are implemented via independent domeswitches. Additionally, each button has been implemented to includeindividually light-able elements. This enables each individual button tobe lit irrespective of the neighboring buttons. Each individual buttoncan be lit in differing ways from neighboring buttons. In oneembodiment, the lighting elements comprise LEDs (Light Emitting Diodes).The versatile keyboard 120 can implement haptic feedback in a mannerthat is localized to one or more specific keys, to a set of keys, or tothe whole device. The haptic feedback is a separate user feedback fromthe physically clickable nature of the buttons.

In one embodiment, the button glyphs (symbols) that are on each of thebuttons are implemented such that they can be visually changed. Suchvisual changes can indicate to a user a particular context of use ormode of operation. The ability to change button glyphs provides a useran intuitive manner to associate multiple functions with a given button,where each function is associated with a unique glyph.

The keyboard 120 embodiment solves a number of long-standing problems incomparison to conventional small device input mechanisms. For example,the individually clickable buttons of keyboard 120 solves issuessupporting the complex game play interaction of complex videogames suchas MMOs and real-time strategy games while using a small portable formfactor. The clickable, physical buttons on the keyboard 120 arecompletely different than virtual buttons. Additionally, the clickablebuttons do not consume any screen area and to not require the user totouch, and therefore occlude, the screen.

The keyboard 120 embodiment of FIG. 1 uses capacitive sensing under eachbutton. The capacitive sensing, in conjunction with functionality thatassociates touch and click of individual buttons to, for example, iconsand shortcuts in a game, greatly improves the usability of smallhandheld to midsized keyboards that are typically utilized with only twothumbs. As described above, the capacitive sensing under each button canbe used for touch-detection. This touch detection can be used to producea pre-click functionality. The pre-click functionality can be used toprovide cues to the user as to which button they are getting ready toclick. The cues provide a hint as to the action that will occur shouldthe button actually be pressed. As such, the clickable buttons can beblindly actuated by a user, meaning the buttons can be actuated withoutthe user taking her eyes off the play area of the screen 110 and lookingat the buttons. The cues can be visual and shown on the screen 110, canbe shown via lighting around individual button, can be audible viaspeakers of the device 100, or the like. In this manner, pre-clickfunctionality can be used to assist the user in positioning her thumbscorrectly over the desired button, thereby accelerating the learningprocess for becoming accustomed to the device 100 or applicationsrunning thereon.

Additionally, the pre-click functionality can assist with the usercorrectly highlighting and selecting small icons on the screen 110. Asdescribed above, complex videogames such as MMOs and real-time strategygames often have small icons designed for PC sized monitors. Such iconscan be, for example, for activating certain in-game features, changingbetween modes, or the like. The pre-click functionality assists the userin correctly highlighting and selecting small icons on a comparativelysmaller screens without requiring the use of a mouse. For example, auser can scan for the desired option by sliding her finger above thekeyboard 120 buttons which activates the pre-click feature to indicatewhich items can be selected for each button.

The keyboard 120 embodiment includes individual lighting elements underevery button. The individual lighting, in conjunction with thefunctionality that controls the lights to indicate active keys, greatlyreduces the visual complexity of the keyboard. As described above, MMOstypically utilize the entire PC keyboard (including letters, numbers,F-keys, Page up, Page down, Tab, Escape, etc). The keyboard 120advantageously provides substantially the entire PC keyboard without theconfusion caused by a large number of buttons in a small form factor.For example, the individual lighting can quickly indicate to a userwhich keys are active in a particular mode (e.g., by visually indicatingthe perimeter only of buttons with active functions for the particularapplication being used). The user can quickly see the manner in whichactive keys change in conjunction with modes changing or applicationcontext changing. In one embodiment, the functionality that controls thelights to indicate active keys is software-based (e.g., implemented viaa keyboard driver or device central processing unit etc.).

In one embodiment, different keyboard states can take place based on thecurrent mode a key is in. States can include, for example, active andlit, inactive and lit, active and clicked, inactive and hover, activeand touch, hover and then touch. An active button state can be one wherepressing, hovering over, and/or touching the button will perform arelated operation in software. For example, a button can be active touchbut inactive click. In one embodiment, touching an active button willcreate one reaction on the screen, while clicking the same button willcreate a different reaction, while hovering over the same button willcreate yet another different reaction. A hover is the placement of afinger (or other object) relatively close to the button but not touchingthe button. The touch sensor can detect this proximate hover and theassociated distance. Hover input can be used in many situations,including indicating pre-click feedback, in-air gesture inputs, hoveringfor a period of time, and hover plus press input types.

User actions can involve multiple keys and/or key regions. The glyphs ineach key can block out individual sides of the key perimeter of thesquares shown in FIG. 1. Thus, 4 keys can be lumped into one larger keyregion/larger key for certain uses. For example, children or elderly canbe assisted playing games with bigger buttons. It would also apply togamers who want the “arcade” feel of bigger buttons. Key regions canalso represent other types and shapes of buttons. For example, lightingup (and making active) a d-pad and implementing d-pad typefunctionality, while the other areas around it are not clickable or havethe touch turned off (inactive).

The keyboard 120 embodiment includes button glyph changing functionalitywhereby the button glyphs (symbols) that are on each of the buttons canbe visually changed. The visual changes can indicate to a user aparticular context of use or mode of operation. For example, switchingfrom English language mode to Japanese or switching from letters mode togame-specific icon mode. The ability to change button glyphs provides auser intuitive manner to associate multiple functions with a givenbutton, where each function is associated with a unique glyph. In thismanner, the glyph changing functionality can reduce the number ofbuttons required to accomplish the similar number of functions on a fullPC keyboard. Thus, a large number of buttons do not need to be crammedinto the small space of a mobile keyboard. This aspect also helps reducethe visual complexity of the keyboard.

The keyboard 120 embodiment combines individually clickable buttons,reconfigurable button lighting, and specific button glyphs to improvepoint and select precision even though the user may be operating thekeyboard 120 using only two thumbs. The improved point and selectprecision improves the learned interaction between the player and theinput, thereby providing for faster response times and a more satisfyinggaming experience. The improved point and select precision makesselecting small icons on the screen 110 more user-friendly. The improvedpoint and select precision due to the combined individually clickablebuttons and specific button glyphs allows for learning modes for new UIs(user interfaces).

In the keyboard 120 embodiment, in addition to solving existingproblems, the combination of the features described above can provide apowerful toolkit for innovation in interaction design. Possibilitiesinclude (but are not limited to):

-   1) Drawing symbols on the keyboard to activate shortcuts or complex    key entries (emoticons, foreign letter accents).-   2) Controlling visual zoom on-screen utilizing gestures.-   3) Capacitive slider controls.-   4) 2-thumb capacitive key chording.-   5) Quick key sequences for fighting games.-   6) Dragging and dropping mapkeys to new button locations without    using on-screen menus.-   7) Keyboard-only games utilizing the button lighting for visual    feedback.-   8) All combinations of touch/click+d-pad/touchpad for shortcuts.-   9) Increasing typing efficiency utilizing pre-click feedback    on-screen.-   10) Developer-driven direct game interfaces.-   11) Learning modes by using lighting and/or haptic feedback for    discovering and selecting shortcuts/specific assets.-   12) Discovery of hidden features by haptic feedback to trigger    click/illumination under a specific key.

In this manner, embodiments of the present invention combine clickablebuttons, capacitive sensing, individual button lighting, andindividually changeable button glyphs to implement a versatile andoptimized keyboard device that greatly improves core aspects of userinteraction design and physical design for a device that both acceptsuser input and provides user output/feedback. In one embodiment, certainaspects of the above described functionality are implemented via asoftware based keyboard driver that executes on the computer systemwithin the keyboard 120 in conjunction with application software (e.g.,computer system 800 in FIG. 8).

Referring now to FIG. 2 and FIG. 3, FIGS. 2 and 3 show the keyboard 120implementing two different configurations in accordance with embodimentsof the present invention. FIG. 2 shows the keyboard 120 in a firstconfiguration. FIG. 3 shows the keyboard 120 in a second configuration.

As shown in FIG. 2 and FIG. 3, depending on a software context, thebutton glyphs of the keyboard 120 are able to change between letters, asshown in FIG. 2, and numbers, as shown in FIG. 3, on the same buttons.This allows for more functionality on fewer buttons without increasingvisual complexity, as described above. In one embodiment, glyphs can beas many as can fit reasonably on the surface of a key, as well as theperimeter of the key as discussed above. Glyphs can include foreignlanguage symbols or any other shape or design. Game publishers may alsointroduce glyph designs specific to their game, which may be loaded intothe keyboard apparatus during setup. Each key has independent glyphcontrol and can be set by a different software context. For example, theA/1 key could show an A and the S/2 key can show a 2 at the same time.This will be discussed further in reference to FIG. 6.

As described above, in one embodiment, the lighting also provides outputto the user, making the versatile keyboard both an input andlow-resolution output device. This is helpful, for example, in teachingstudents keyboard usage. Another usage example is playing the populargame nibbles just based on using the capacitive touch of the keyboardand the lighting feedback. Another usage example is to use the lightingon the keyboard in a music game mode where the lighting moves along thekeyboard to indicate timing for certain gaming actions. Lights couldalso be a factor in playing a type of “battleship” game on the device.Thus, some games would not need a separate display screen at all foradditional user output and feedback.

In one embodiment, the lighting can be projected in varying intensitiesas well. For example, the user can set the brightness similar to thebrightness on a display screen, or the lighting can self adjust based onroom conditions with an added light sensor. Thus, the lighting can blinkand provide various other feedback to the user based on each individualbuttons' intensity level. In one embodiment, the lighting can be ofvarying colors based on LED selections or filters placed above the LED.Glyph layouts can also affect the colors shown to the user.

FIG. 4 shows an exemplary physical implementation of a button of thekeyboard 120 in accordance with one embodiment of the present invention.This implementation incorporates physical dome switches, individualbutton lighting, and a capacitive FPC (flexible printed circuit) into asingle small device.

LED 402 provides the light for backlighting the glyphs and the sides ofthe buttons. The top of the button is a clear piece 404. Underneath thatis the translucent light pipe 406. Adhesives 408 (e.g., alternativelycolor filters) attach the light pipe to a capacitive touch sensor layer410. A reflective foil layer 412 is on the underside of the touch sensorlayer 410. A nub 414 is connected to the reflective layer and isdisposed over a dome switch 416 comprising a number of layers oflaminate 418 and a PCB (printed circuit board) 420.

As shown in the FIG. 4 embodiment, the capacitive touch sensor below thesurface of the key allows for touch actions with the keyboard. Thisallows for multi-touch functionality, gesture functionality, hover andtouch functionality, pre-click feedback functionality, among others, inthe manner described above. Depending upon the usage scenario, specificgestures applicable to gaming include the pan and zoom functions ofmoving around an in-game world. Other gestures can be used for changingthe map-keys.

The capacitive touch component also brings together the possibility ofpressure sensitivity on a touch of the device. This can detect pressureon the device as well as distance away from the device (e.g., as is usedin providing pre-click functionality).

Pre-click functionality is a key component in gaming that the capacitivetouch allows. For example, in one embodiment, users can hover theirfinger over a key to see on the screen which menu option or action willhappen based on a click or a certain gesture. A menu can appear to theuser on screen to give the user options as to what happens when theyclick, touch, slide right, slide left, hold for certain amount of time,etc. This allows for many types of gaming interactions to be improvedupon and customized for the actual usage of users.

In another embodiment, haptic feedback can be provided to users based onthe user's touch of a button. If a user touches a button and does notclick on the button, the versatile keyboard 120 can provide hapticfeedback to the user, thus providing feedback that the button wastouched. Haptic feedback allows for improved implementation of gestureand touch precision relative to the capacitive touch sensing of theversatile keyboard 120.

FIG. 5 shows an exemplary glyph changing implementation of a button ofthe keyboard 120 in accordance with one embodiment of the presentinvention. As shown in the FIG. 5 embodiment, the glyph changingfunctionality is implemented via use of multiple layered components. Atthe top resides a semi-translucent film 502. The film 502 is ideallymolded with tactile forms over each button area. Underneath the film 502is a mask 504. The mask 500 is typically a clear film screen printedwith opaque glyph negatives, in this case, the outlines of a box, thenumbers 1 and 2, and the symbols ! and @. Next is a transparentsegmented LCD (liquid crystal display) layer 506. Underneath the LCDlayer 506 resides an electroluminescent backlight and a uniform diffuserlayer 508. The transparent segmented LCD layer 506 functions as ashutter, selectively allowing light from layer 508 shine through. Thiseffect is shown in the discussion of FIG. 6 below. While the light frombacklighting is helpful in viewing the glyphs, light is not required forthe user to see which glyph is active.

As evident from FIG. 5, more than one glyph can be viewable at the sametime. This allows for multiple glyph combinations active per key. Forexample, a glyph can have four sections and as the user solves a puzzle,the four individual glyph sections can become visible using thesegmented LCD layer 506. Also, a user can see all the glyph options fora button in certain modes, for example, a configuration mode.

FIG. 6 shows a plurality of scenarios of backlighting and LCDsegmentation to implement changeable glyphs in accordance with oneembodiment of the present invention. In the first scenario 602, the LCDsegments are shuttered as shown, such that light from the backlight canshine through to the 1 and the 2 glyphs as shown. In the second scenario604, the LCD segments are shuttered as shown, such that light from thebacklight can shine through to the symbols ! and @ as shown. In thethird scenario 606, the LCD segments are shuttered as shown, such thatlight from the backlight can shine through to the outlines of a box asshown. Thus, FIG. 6 illustrates one implementation for implementing thechangeable glyphs for each of the buttons of the keyboard 120.

FIG. 7 shows certain components of an exemplary versatile keyboardsystem 700 according to one embodiment of the present invention. Asdepicted in FIG. 7, the versatile keyboard system 700 illustratescertain components 702-712 which implement aspects of both inputfunctionality and output functionality of the keyboard apparatus. Asshown in the FIG. 7 embodiment, the input aspects of the versatilekeyboard functionality are implemented via the click input components702 (e.g., the buttons of the keyboard device) and the touch sensorinput components 704 (e.g., the capacitive touch sensing componentsunder each button). The output aspects of the versatile keyboardfunctionality are implemented via the lighting elements 708, the glyphs710 and one or more haptic components 712. As described above, thelighting elements 700 comprises the multiple light sources (e.g., LEDs)that illuminate each button and/or different portions of each button.The glyphs comprise the symbols which occupy each button and which canbe independently changed. The haptic component 712 comprise one or morehaptic feedback mechanisms which provide haptic feedback on a per buttonbasis, for a group of buttons, or for the entire device as describedabove. The central controller 706 handles processing of both the inputfunctionalities (e.g., components 702-704) and the outputfunctionalities (e.g., components 708-712) of the keyboard system 700.The central controller 706 can be a controller within and specific tothe versatile keyboard 700 or can be the controller of a larger computersystem (e.g., a CPU).

FIG. 8 shows an exemplary computer system 800 according to oneembodiment. Computer system 800 depicts the components of a basiccomputer system providing the execution environment for certainhardware-based and software-based functionality for the above describedembodiments. For example, computer system 800 can be a system upon whicha versatile keyboard driver 850 and one or game applications 860 areinstantiated. Computer system 800 can be implemented as, for example, aserver computer system, workstation computer system, desktop computersystem, or laptop computer system. Similarly, computer system 800 can beimplemented as a mobile, handheld device. Computer system 800 typicallyincludes at least some form of computer readable media (e.g., computerreadable storage medium 801). Computer readable media can be a number ofdifferent types of available media that can be accessed by computersystem 800 and can include, but is not limited to, computer storagemedia.

In its most basic configuration, computer system 800 typically includesprocessing unit 803 and a computer readable storage medium 801.Depending on the exact configuration and type of computer system 800that is used, memory 801 can be volatile (e.g., such as DRAM, etc.) 801a, non-volatile 801 b (e.g., such as ROM, flash memory, etc.) or somecombination of the two. Similarly, the memory 801 can comprise otherdevices besides solid-state devices, such as, for example, magneticdisk-based media, optical media, or the like.

Additionally, computer system 800 can include other mass storage systems(e.g., removable 805 and/or non-removable 807) such as magnetic oroptical disks or tape. Similarly, computer system 800 can include inputdevices 809 (e.g., such as the versatile keyboard 120) and/or outputdevices 811 including speakers, haptic feedback components, lights,vibration motors, a display (e.g., such as a display 110) and the like.Computer system 800 can further include network and communicationsconnections 813 to other devices, computers, networks, servers, etc.using either wired or wireless media.

Many other devices or subsystems (not shown) may be connected in asimilar manner (e.g., document scanners, digital cameras and so on).Conversely, all of the devices shown in FIG. 8 need not be present topractice the present invention. The devices and subsystems can beinterconnected in different ways from that shown in FIG. 8. Theoperation of a computer system such as that shown in FIG. 8 is readilyknown in the art and is not discussed in detail in this application.Code to implement the present disclosure can be stored incomputer-readable storage media such as one or more of system memory,fixed disk, optical disk, or floppy disk. The operating system providedon computer system 800 may be MS-DOS®, MS-WINDOWS®, OS/2®, UNIX®,Linux®, or another known operating system.

Moreover, regarding the signals described herein, those skilled in theart will recognize that a signal can be directly transmitted from afirst block to a second block, or a signal can be modified (e.g.,amplified, attenuated, delayed, latched, buffered, inverted, filtered,or otherwise modified) between the blocks. Although the signals of theabove described embodiment are characterized as transmitted from oneblock to the next, other embodiments of the present disclosure mayinclude modified signals in place of such directly transmitted signalsas long as the informational and/or functional aspect of the signal istransmitted between blocks. To some extent, a signal input at a secondblock can be conceptualized as a second signal derived from a firstsignal output from a first block due to physical limitations of thecircuitry involved (e.g., there will inevitably be some attenuation anddelay). Therefore, as used herein, a second signal derived from a firstsignal includes the first signal or any modifications to the firstsignal, whether due to circuit limitations or due to passage throughother circuit elements which do not change the informational and/orfinal functional aspect of the first signal.

The foregoing description, for the purpose of explanation, has beendescribed with reference to specific embodiments. However, theillustrated discussions above are not intended to be exhaustive or tolimit the invention to the precise forms disclosed. Many modificationsand variations are possible in view of the above teachings. Embodimentswere chosen and described in order to best explain the principles of theinvention and its practical applications, to thereby enable othersskilled in the art to best utilize the invention and various embodimentswith various modifications as may be suited to the particular usecontemplated.

1. A keyboard input and output device, comprising: a housing having aplurality of buttons, with each button individually clickable; acapacitive sensing element under each button for touch sensing; alighting element under each button to provide selective lighting foreach button; and a plurality of button glyphs for the plurality ofbuttons respectively, wherein the button glyphs are selectively visuallychangeable, and wherein the selective lighting for each button passesthrough the button dependent on the glyph selection.
 2. The device ofclaim 1, wherein each button is individually clickable via the actuationof an independent dome switch for each button.
 3. The device of claim 1,wherein the selective lighting for each button can be changed based uponan application context.
 4. The device of claim 1, further comprising ahaptic feedback mechanism included in the housing for providing hapticfeedback for the plurality of buttons; wherein the haptic feedbackmechanism provides haptic feedback localized to an individual button outof the plurality of buttons.
 5. The device of claim 4, wherein thehaptic feedback mechanism provides haptic feedback in response to atouch sensing detection by the capacitive sensing element.
 6. The deviceof claim 1, wherein the capacitive sensing element provides hoverdetection.
 7. The device of Claim I , wherein the housing is sized as ahandheld device.
 8. A keyboard system, comprising: a body having aplurality of buttons, with each button individually clickable via theactuation of an independent dome switch; a capacitive sensing elementunder each button to implement touch sensing for each button, whereintouching a given button creates a first reaction and clicking the givenbutton creates a second reaction; a lighting LED (light emitting diode)under each button to provide independent selective lighting for eachbutton, wherein lighting for each button can be changed based upon anapplication context; and a plurality of button glyphs for the pluralityof buttons respectively, wherein the button glyphs are selectivelyvisually changeable; wherein the selective lighting for each buttonpasses through the button dependent on the glyph selection.
 9. Thesystem of claim 8, further comprising a haptic feedback mechanismincluded in the housing for providing haptic feedback for the pluralityof buttons; wherein the haptic feedback mechanism provides hapticfeedback localized to an individual button out of the plurality ofbuttons.
 10. The system of claim 9, wherein the haptic feedbackmechanism provides haptic feedback localized to a set of buttons out ofthe plurality of buttons.
 11. The system of claim 8, wherein the whereinthe capacitive sensing element provides hover detection.
 12. The systemof claim 11, wherein the hover detection implements a pre-click functionthat indicates a characteristic of the second reaction.
 13. The systemof claim 8, wherein the body is sized as a handheld device.
 14. Thesystem of claim 8, wherein the lighting LEDs are disposed under thebuttons to visually indicate the perimeters of each button.
 15. Thesystem of claim 14, wherein the plurality of lighting LEDs under thebuttons are selectively controlled to indicate those buttons, out of theplurality of buttons, that have an active function for an applicationbeing used.
 16. The system of claim 8, wherein the touch sensing foreach button and the first reaction implement a pre-click function thatindicates a characteristic of the second reaction.
 17. The system ofclaim 8, wherein at least two buttons out of the plurality of buttonsand the selective lighting for each button cause the at least twobuttons to appear as a single larger button and function as a singlelarger button.
 18. The system of claim 17, wherein a set of buttons outof the plurality of buttons and the selective lighting for each buttoncause the set of buttons to appear as a larger d-pad shaped buttonhaving a d-pad function.
 19. The system of claim 8, wherein thecapacitive sensing element under each button creates a proximitydetecting function to cause a third reaction upon a close proximityhover over the given button.
 20. The system of claim 8, wherein thecapacitive sensing element under each button implements a gesture inputfunctionality for the plurality of buttons. 21-28. (canceled)